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Living cells are continually exposed to environmental signals that vary in time. These signals 
are detected and processed by biochemical networks, which are often highly stochastic. To under- 
stand how cells cope with a fluctuating environment, we therefore have to understand how reliably 
biochemical networks can transmit time-varying signals. To this end, we must understand both 
the noise characteristics and the amplification properties of networks. In this manuscript, we use 
information theory to study how reliably signalling cascades employing autoregulation and feedback 
can transmit time-varying signals. We calculate the frequency-dependence of the gain-to-noise ratio, 
which reflects how reliably a network transmits signals at different frequencies. We find that the 
gain-to-noise ratio may differ qualitatively from the power spectrum of the output, showing that 
the latter does not directly reflect signaling performance. Moreover, we find that auto-activation 
and auto-repression increase and decrease the gain-to-noise ratio for all of frequencies, respectively. 
Positive feedback specifically enhances information transmission at low frequencies, while negative 
feedback increases signal fidelity at high frequencies. Our analysis not only elucidates the role 
of autoregulation and feedback in naturally-occurring biological networks, but also reveals design 
principles that can be used for the reliable transmission of time-varying signals in synthetic gene 
circuits. 



I. INTRODUCTION 

Living cells constantly have to respond and adapt to 
a changing environment. In some cases, such as in re- 
sponse to a changing sugar concentration pQ, a cell may 
wish to integrate out rapid variations and only respond to 
slow variations of the environmental signal, while in other 
cases, such as osmo adaptation [2] or bacterial chemotaxis 
[5] , the cell needs to do the opposite — respond to rapid 
but not slow variations (adaptation). Indeed, to under- 
stand how cells cope with a fluctuating environment, we 
have to understand how cells transduce time- varying sig- 
nals. Cells detect, process, and transduce signals via bio- 
chemical networks, which are the information processing 
devices of life. However, experiments in recent years have 
demonstrated that biochemical networks are often highly 
stochastic |H [5]. This raises the question how reliably 
biochemical networks can transmit time-varying signals 
in the presence of noise. 

Interestingly, biochemical networks exploit commonly 
recurring architectures [H[7], such as autoregulation, cas- 
cades, and feedback, to process signals. These network 
motifs often implement signal amplification in order to 
raise the level of the input signal relative to the noise. 
Amplification can be characterised by the gain, the fold- 
change in the signal amplitude. However, it is important 
to recognise that such amplification can not only increase 
the levels of the desired signal, but can also amplify the 
noise itself. Therefore, to understand the possibilities 
and limitations of different network motifs for enhancing 
the fidelity of signal transduction, we need to understand 



* dcrondo@amolf. 



nl 



how both the signal and the noise are propagated through 
these motifs. Specifically, information theory indicates 
that the reliability of signal transmission is determined 
by the ratio of the gain of the network to the total noise 
in the output signal — the gain-to-noise ratio. More- 
over, to assess how reliably signals of different temporal 
characteristics are transduced, we have to understand the 
frequency dependence of the gain and the noise. Impor- 
tantly, we expect that different network architectures will 
affect the frequency-dependence of the gain and the noise 
differently, which means that we have to study both these 
quantities. In this manuscript, we study the frequency- 
dependence of the gain-to-noise ratio for simple cascades, 
and for cascades employing autoregulation and feedback. 
This allows us to elucidate how autoregulation and feed- 
back can shape the frequency range over which signals 
can be transduced reliably. 

Information theory provides a formalism for quanti- 
fying the reliability of information transmission in the 
presence of noise [5]. A natural measure for the fidelity 
of signal transmission from an input signal S to an output 
signal X (the network response) is the mutual informa- 
tion between S and X, which is defined as 

I(S, X) =H(S)-H(S\X) 

dS P (S)log[p(S)}- 



(1) 



Here, p(S) and p(X) are the probability distributions 
of possible input and output signals respectively, and 
p (S\ X) is the conditional probability of S once X is spec- 
ified. The mutual information quantifies the reduction in 
entropy of (or uncertainty about) the signal after one ob- 



dXp(X) / dS P {S\X) log [p{S\X)~ 
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tains knowledge of the network response, averaged over 
all possible responses. In other words, I(S, X) is how 
much we learn (on average) about S by measuring X. 
For a deterministic system, every S leads to a unique X 
(we assume no degeneracy). Measuring X thus precisely 
specifies S, such that the uncertainty in S after a mea- 
surement of X is H(S\X) = and I(S,X) = H (S). 
However, in the presence of noise in the network each 
input S will lead to a distribution of possible outputs X. 
As a result, an observed X can correspond to multiple 
S values and I (S, X) < H (S). For completely uncorre- 
cted S and X, I(S, X) — 0. By construction, the mutual 
information is symmetric, such that I (S, X) = I (X, S). 

Recently, the mutual information has been used to 
study the reliability of information transmission in bio- 
chemical networks [9HT3]. However, these studies con- 
sidered only the steady-state response of a network to 
a distribution of constant input signals, which do not 
change on the timescale of the network response. Yet, in 
many biological systems, it cannot be assumed that the 
input signal is constant on the timescale of the network 
response. 

Indeed, in many systems the message is encoded in the 
temporal dynamics of the input signal. A well-known ex- 
ample is bacterial chemotaxis, where the concentration 
of the intracellular messenger protein depends not on 
the steady-state ligand concentration, but rather on the 
change of this concentration in the recent past [T3] — the 
response of the network thus depends on the history of 
the input signal. Moreover, the extracellular signal may 
be encoded in the temporal dynamics of the intracellu- 
lar signal transduction pathway. An interesting example 
is provided by the rat PC-12 system: while stimulation 
with a neuronal growth factor gives rise to a sustained 
response of the Raf-Mek-Erk pathway stimulation by an 
epidermal growth factor gives rise to a transient response 
of this pathway 14J. In all these cases, the message is en- 
coded not in the concentration of some chemical species 
at a given moment in time, but rather in its concentra- 
tion as a function of time. This means that to under- 
stand how reliably the network can transmit informa- 
tion, we need to know how accurately an input signal as 
a function of time — the input trajectory s (t) — can be 
mapped onto an output trajectory x(t). We thus need 
to understand the mutual information between the two 
trajectories, I (s (t) ,x(t j). 

The ability of a biochemical network to transduce a 
time- varying input signal depends on the correlation time 
of the input signal and the architecture and response 
dynamics of the network. An instructive example is 
provided by the chemotaxis network of the bacterium 
Escherichia coli. This network employs integral nega- 
tive feedback [15], as a result of which the intracellular 
messenger protein can adapt to a constant extracellu- 
lar ligand concentration. This means that the signalling 
network cannot respond to changes in ligand concentra- 
tion that occur on time scales longer than the adap- 
tation time. At the other end of the frequency spec- 



trum, changes in the messenger protein that occur on 
time scales shorter than the motor switching time will 
be integrated out; indeed, the network cannot respond 
reliably to rapidly varying input signals [TB_]. The ar- 
chitecture and the response dynamics of the processing 
network thus determines the frequency range over which 
signals can be transduced reliably. 

Recently, we have applied information theory to bio- 
chemical networks and studied the mutual information 
between in- and output trajectories, I(s(t),x(t)) [IB] . 
Here, we apply this framework to study the propaga- 
tion of time-varying signals through a number of net- 
work motifs — cascades, autoregulation, and feedback. It 
is known that for constant signals (or, to be more precise, 
signals that do not vary on the time scale of the network 
response time), the mutual information decreases as a 
function of cascade length [IT] . The same also holds true 
for time-varying signals. Indeed, the data-processing in- 
equality states that in a cascade with n nodes, the in- 
formation about the input encoded in the signal at node 
i + 1 cannot be greater than the information at node i. 
Once lost, information about the input cannot be recov- 
ered later in the cascade. Simply increasing the length 
of a signalling cascade therefore can never increase the 
transmitted information. Conversely, maximising the to- 
tal transmitted information cannot be the driving force 
behind the evolution of such cascades. 

Cascades, however, often employ autoregulation and 
feedback, which can be used to shape the response of 
the network to signals of different frequencies. Impor- 
tantly, autoregulation and feedback affect not only the 
frequency-dependent gain, which describes how strongly 
an input signal at a particular frequency is amplified 
in the absence of any biochemical noise, but also the 
frequency-dependence of the noise. While the frequency- 
dependence of the gain [T7HT9] and the noise [20] have 
been studied separately, the frequency-dependence of 
their ratio, the gain-to-noise ratio, has not. However, it 
is the gain-to-noise ratio which determines how reliably 
an input signal at a particular frequency can be trans- 
mitted [16] . In fact, as we will show, autoregulation and 
feedback affect the frequency-dependence of the gain and 
the noise differently, which means that it is essential to 
study these quantities together. 

In this manuscript, we study the frequency-dependent 
gain-to-noise ratio using a Gaussian model. In the next 
section, we describe this model, and how we can use it 
to compute the frequency-dependent gain-to-noise ratio 
and the information transmission rate, which is given by 
the integral of this ratio over all frequencies [IB]. In sec- 
tion Results we discuss the frequency-dependent gain-to- 
noise ratio of simple cascades, and cascades employing 
feedback and autoregulation. Our results highlight the 
idea that the output power spectrum is not a direct mea- 
sure for the information content of the output signal — 
the output power spectrum can differ qualitatively from 
the spectrum of the gain-to-noise ratio. We also show 
(Fig. [7]) that positive regulation tends to increase the 
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gain-to-noise ratio, while negative regulation tends to de- 
crease it. Moreover, we show that the frequency spectra 
of motifs with negative feedback can exhibit windows in 
which the gain-to-noise ratio is increased; these motifs 
can thus act as band-pass filters for information trans- 
mission. Finally, we discuss some of the implications of 
our findings and the limitations of our analysis. 



II. METHODS 

We consider information transmission through a bio- 
chemical network from an input signal s (t) to an out- 
put signal x(t). The dynamics of the network can be 
described mathematically by a set of coupled Langevin 
equations }21j for the signal, response and an arbitrary 
number of intermediate components u,, in vector form v. 
In using the Langevin representation we assume that the 
copy number of each component is large such that the 
discrete number of molecules can be approximated by a 
continuous concentration. 



ds 
dt 



/+( s ) + /7(«) + r(t) 



dv 
~dt 



dx 



f+(s,v,x) - f v (s,v,x)+ri v (t) 



= fx ( s = v i x ) ~ fx («) v, x) + X] x (t) . 



(2a) 



(2b) 



(2c) 



Here, ft and /~ contain all the reactions involving the 
production and degradation of component z, respectively. 
ft and /~ only depend on s, so that we restrict our 
analysis to networks that do not feed back onto s it- 
self. In these cases, the gain-to-noise ratio is indepen- 
dent of the input signal |2"2"1 . as discussed in more de- 
tail below Eqn. 
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r (<) is a stochastic driving pro- 
cess that serves to define the ensemble of possible in- 
put signals. The various noise sources % are taken to 
be independent and Gaussian-distributed 22-24 , such 



that (rji (t) r]j (i')) = (\r]i\ J Sijd(t — t'). Here, we note 

that the assumption of independent noise sources is only 
made to simplify the analysis. (Anti)-correlations be- 
tween noise sources can affect noise propagation |22j . 
and can be included by a straightforward extension of 
the present discussion. Furthermore, we assume that 

(h\ 2 ) = {ft) + {fi) = 2 (ft) (|r| 2 ) = 2 (f+) 

|25j . the sum of the production and degradation terms. 

We introduce the vector y = (s;v;x) and rj = 
(T,r) v ,r] x ) and assume the network has a steady state 
(y). Linearizing around this steady state we obtain 



dy 

dt 



J\ y =(y)y + V- 



(3) 



Here y~i = y% — (yi) is the deviation of the concentration of 
component i from its steady-state value, (yi), and J is the 



Jacobian evaluated at the steady state [Mj . Jij describes 
the response of the component i to small changes in com- 
ponent j, while keeping all other components at their 
steady-state levels. The diagonal element J a — — r^ 1 is 
the relaxation time or dissipative time scale of component 
i; it describes the time scale on which component i relaxes 
back to its steady-state value after a perturbation. After 
linearization, the architecture of the network is encoded 
in the structure of the Jacobian matrix (see Fig. [IJ: the 
diagonal terms correspond to autoregulation, the lower 
triangular part to downstream (feedforward) regulation 
and the upper triangular part to upstream (feedback) 
regulation. Since we restrict ourselves to systems with- 
out feedback from the network to the signal itself, we 
require that all elements on the first row of J are zero 
but for J ss . 




FIG. 1. The Jacobian matrix. The entries of the 
Jacobian matrix encode the structure of the reaction 
network. 

We take as our input signal the variations s. A linear 
system does not change the frequency of the transmit- 
ted signal, but only the amplitude and the phase. Since 
Eqn. ([3| is linear in y, we can calculate exactly the power 
spectra of the network components [25] . 



\iujl - 



jr x B 



-iuA - J 1 



(4) 



where Pij(oS) = (Yi(w)Yj(—uS)J is the (cross-)power 

spectrum of yi and jjj, Yi (w) is the Fourier transform 
of iji (i), I is the identity matrix, and H is the noise ma- 
trix with entries 3^- = (r]i(u))r]j(—u))) = ^|?7i| 2 ^ 5y. The 
power spectrum is a commonly used tool to study time- 
varying signals, and describes how the total power of a 
signal is distributed over different frequencies. Power at 
low frequencies is related to slow variations of the sig- 
nal, while power at high frequencies corresponds to rapid 
fluctuations. The integral of the power spectrum over all 
frequencies equals the total variance of the signal. 

The information transmission rate for time- varying sig- 
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nals is [13115] 



I(s(t),x(t)) „, , , 
lim — — = i? (s (t) , x (t)) 

1 — >oo 1 



i / dwlnfl-^H], (5) 



where T is the length of the trajectory and & sx (lu) is the 
coherence function, defined as 



P ss (uj)P xx (uj) 



(6) 



$ sx (w) is a measure of the average correlation between 
the in- and output signals in the frequency domain. For 
completely independent in- and output signals, $> sx (w) — 
0, while for a noiseless system Q sx (ui) = 1. 

The power spectrum of the output signal, P xx (co), can 
be decomposed as 



= g 2 (uj)P ss (u)+N(u). 



(7) 

(8) 



Here, S(w) = g 2 (oj) P ss {uS) is the transmitted signal, 
<7 2 (cj) = |P aa .(a;)| /P 2 s (uj) is the frequency-dependent 
gain, P ss (uj) is the power spectrum of the input signal 
and N(ui) is the frequency-dependent noise. With these 
definitions, the coherence function, Eq. [6j can be recast 
as 



E(w) 



(9) 



N(u)) + E(u))' 

and the mutual information rate can be rewritten as [16 



R(s (t),x(t)) 



1 

2^ 



du In 



1 



N(w) 



( 10 ) 

We see that the information transmission rate depends 
on the power spectrum of the input signal, P ss (u), and 
on the gain-to-noise ratio g 2 (u})/N(uj). 

As discussed in Ref. |22| . in a biological system the 
reaction that detects the input signal can, depending on 
the nature of the detection reaction, introduce significant 
correlations between the variations in the input signal 
and the intrinsic noise of the reactions that constitute 
the processing network. These correlations are a conse- 
quence of the molecular character of the components and 
are thus unique to biochemical networks. If the detec- 
tion reaction does not introduce correlations, then Eqn. 
[8] is the spectral- addition rule [55]. The noise N(uj) is 
then the intrinsic noise of the processing network and 
also g 2 {oj) only depends on properties of the processing 
network. On the other hand, if the detection reaction 
does introduce correlations, then the output power spec- 
trum P xx {lo) can be written in the form of Eqn. |8j but 
then N(cj) and g 2 (uj) depend not only on characteris- 
tics of the processing network, but also on the statistics 
of the input signal; conversely, the variations of the in- 
put will also be affected by the noise in the processing 



network |22j. In what follows below, we assume for sim- 
plicity that the spectral-addition rule holds, which means 
that the gain, noise and gain-to-noise ratio are indepen- 
dent of the input signal, and that the input does not need 
to be specified. 

Applying the linearization procedure outlined above 
may, in general, qualitatively change the dynamics of 
the network being considered. However, previous studies 
[3 [55] have shown that the Linear Noise Approximation 
provides an accurate description of many systems if the 
average copy numbers are of order 10 molecules or more. 
For the networks considered in this paper we also com- 
pared the power spectra calculated in the linear approx- 
imation with the results of stochastic simulations per- 
formed with Gillespie's algorithm |30j . and again found 
good agreement when protein copy numbers are large 
(see SI). We therefore expect that the linear analysis 
presented in this paper provides an accurate description 
of the signalling characteristics of these networks. 



III. RESULTS 

First we study a simple cascade, where "simple" means 
that we consider a cascade where each component only 
regulates the activity of the next component in the cas- 
cade; a "simple" cascade is thus a cascade without au- 
toregulation, feedback or feedfoward. We analyse this 
network in detail such that it can serve as an instructive 
example of the method described above. In addition, we 
will highlight general features of the results which recur 
in more complex networks. We then discuss network mo- 
tifs including autoregulation and negative feedback loops, 
which are commonly observed in biochemical networks. 

To understand the effects of autoregulation and feed- 
back we will compare information transmission in these 
motifs to a corresponding simple cascade with the same 
number of components but without the additional regu- 
lation. In order to perform such a comparison of different 
motifs on an equal footing we constrain the average pro- 
duction rate of every component such that these are equal 
in the networks under comparison. We argue that from 
a biological perspective the rate of protein production is 
a more significant constraint on network design than av- 
erage protein copy number, since the latter only depends 
on the ratio of the synthesis and degradation rate, while 
it is the absolute synthesis and degradation rate that 
determines the cost of having a protein at a particular 
copy number. This constraint also enforces that the noise 

strength at each level of the cascade ^|f/i| 2 ^ = 2 (f^) is 

the same in the motifs being compared. When compar- 
ing two systems with many parameters, equalising pro- 
duction rates is not a sufficient constraint to uniquely 
specify all parameter values. To reduce this potential 
parameter space we will (unless otherwise stated) hold 
constant as many of the network parameters as possible. 
For brevity we will only discuss networks in which all reg- 
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ulation occurs via the production reactions, with linear 
degradation of each component. However, our results are 
qualitatively unchanged if we instead consider regulation 
via protein degradation. 

We characterise information transmission through 
these motifs in terms of the gain, noise and gain-to- 
noise ratio. Since we assume that the spectral-addition 
rule holds [22] . these quantities are intrinsic, signal- 
independent properties of the network. We also wish 
to highlight differences between the information trans- 
mission characteristics of the network, as determined by 
the gain-to-noise ratio, and the output power spectrum 
P xx (ui), since this is commonly discussed in studies of 
signal transmission. Since P xx (uj) depends not only on 
the processing network but also on the input signal (see 
Eq. [sj), we must therefore specify P ss (uj); for this pur- 
pose we assume, for convenience, that the input signal 
s(t) is generated via a Poisson birth-death process as in 
Eqn. |lla| ( The simple cascade). 



A. The simple cascade 

Initially we study a simple cascade with a single in- 
termediate component. Extension of the cascade with 
more intermediate components is straightforward. The 
appropriate reaction scheme is 



obtain for the power spectrum of x, 



ds 
~dt 
dv 
~df 
dx 
~dl 



k s - fj, s s + T (t) 
k v s - fx v v + Th (t) 
k x v - fi x x + rj x (t) . 



(11a) 
(lib) 
(11c) 



We reiterate that we assume that there are no cross cor- 
relations in the noise; (f]a{t)r]p{t')) — 5 a p5(t — t') and 
(r (t) rj a (t')) — 0. This means that the reactions are of 
the type s — > s + v and v — > v + x, and not s v and 
v — > x, respectively; put differently, the firing of a reac- 
tion does not consume a molecule of the reactant, and 
hence does not affect the fluctuations of the up-stream 
component [22j . In the Discussion section, we will briefly 
address some of the limitations of this assumption. 
Fourier transformation gives 



=rnal 



X(u) 



k x k v S 



(ius + fi x ) (iui + i± v ) 
k x r) v (uj) 



(iu + fj, x ) (iu + /J, v ) iuj + fi x 



(12) 



As indicated, we can identify the components of the out- 
put which are due to the input S ("signal") and compo- 
nents which arc due to intrinsic noise in the network. We 



s 2 M 



2/Ce 



/ - - \ k 2 k 2 
(XX*) = — 

\ / (^ 2 + M 2) (u 2 +fi 2 v ) (W 2 +^) 



A. .. 



2k x (v) 



(u 2 + nl) {uj 2 + fi 2 v ) {uj 2 + h 2 x ) 



(13) 



N(ui) 

Fig. [2j\ shows the output power spectrum of this net- 
work P xx (oj) (red), as well as its decomposition into the 
noise N(oj) (green) and the transmitted signal E(w) = 
g 2 (uj)P ss (oj) (black solid) (see also Eqn. Sh. Simple cas- 
cades are characterised by a number of "knee" frequencies 
(vertical dashed), corresponding to the characteristic re- 
laxation rates of the different components of the network 
(in this and /i x ). These knee frequencies are 

the inverse of the response times of the components - 
e.g. n v =r" 1 . 

In order for the processing network to track variations 
in the input s on a time scale the network should 
be able to respond on this time scale. If any component 
of the processing network has a longer response time, 
this variation in s will be filtered. This filtering can be 
observed in the transmitted signal where at fre- 

quencies above the first knee frequency, S(w) scales with 
uj~ 2 and for every consecutive knee frequency, S(w) de- 
cays with an additional factor lu~ 2 (Fig. [2]^). In effect 
each level of the cascade acts as a low-pass filter, because 
the incoming signal is averaged over the protein response 
time. Mathematically, the transmitted signal S(w) can 
be factored into the input signal P ss (w) (black dashed), 
and the total gain g 2 (oj) (Fig. [2^3, black), which is inde- 
pendent of the input signal (because we assume that the 
network does not feed back onto s). Moreover, the total 
gain of the network is the product of the gain of each 
cascade step: g 2 (co) = g 2 ^ v (uj)gl^ x (uj); decaying as u;~ 4 
for uj ^> /i„,/i x (Fig. [2j3) . Consequently, the transmitted 
signal S(w) decays as uj~ 6 for uj ^> /i s , fi v , ju, x . 

Since we assume that there are no cross-correlations 
between the different noise terms, the total noise N(u) 
(green line in Figs. [2j\_ and [2j3) is given by the noise- 
addition rule [22 131 j . which means that N(uj) is sim- 
ply given by the sum of two independent contributions, 
N v ^ x (uj) (Fig. [2j3 , green dotted) and N x (uj) (green 
dashed) (see Eqn. 13). Here, N x (lu) is the noise in the 



concentration of x that arises from the intrinsic stochas- 
ticity in the production and decay events of x\ N x (oj) 
would be the total variance in the concentration of x 
if v, the input for x, would not vary over time. How- 
ever, the upstream component v does vary in time, not 
only because it is driven by variations in the input s, but 
also because it fluctuates spontaneously due to the noise 
in its synthesis and decay events. This noise is propa- 
gated to x. Its contribution to the total noise power of 
x is N v _,. x (uj), which is given by the noise in v, N v (u>), 
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multiplied by how much this noise is amplified at the 



level of x, given by g 2 ^ x (uj): N v ^ x (u) 



»JV„(w) 



/4)- 



The "extrinsic" contri- 



decays as w since 



where g%_> x = k 2 x /(u 2 
bution to the noise in x, N v 
the noise in v, decaying as uj~ 2 , is filtered by the finite 
lifetime of the protein x. The "intrinsic" contribution, 
N x (u), decays as u>~ 2 , meaning that for w ^> /U„,/i x , 
N(w) ~ N x (w). Hence, while the transmitted signal 
decays as w~ 6 for u> ^> (i s , [A v , t*x, the noise N(ui) 
decays as u>~ 2 (Fig. KB, green solid). As a result, for fre- 
quencies uj 3> (J> s) fJ> v , Hx, the transmitted signal is 
completely obscured by the noise and the output P xx (uj) 
is simply given by the noise N(oS) (FigJSK). 
Finally, the gain-to-noise ratio (Fig. [2H, red) is 
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k v k x fj> v 



(14) 



This expression shows that the simple cascade effectively 
acts as a low-pass filter for information, meaning that it 
cannot reliably respond to signals that vary (much) faster 
than a characteristic cut-off frequency lu 2 — [i v {p, v + k x ). 
We note that the gain-to- noise ratio is independent of fi x , 
since both the gain and the noise have the same func- 
tional dependence on jj, x . This is a general feature of 
the biochemical networks we will study: degradation of 
the output species occurs independently of the upstream 
components, and therefore provides no additional infor- 
mation about the input [16] . 



B. Autoregulation 

In this section we consider direct feedback of a compo- 
nent onto its own production, as indicated in Fig.[3|V and 
[4]A.. Autoregulation is one of the most common forms of 
regulation in signalling networks. It is well known that 
negative autoregulation speeds up the response time of 
components, which can also change the response time of 
the complete signalling cascade 32 . Positive autoreg- 
ulation slows down the response time and can lead to 
bistability |3"2ll3"3] . 

Autoregulation alters only the diagonal entries of the 
Jacobian matrix (Fig. [I]) . This means that the character- 
istic timescale for dissipation of small fluctuations — the 
response time — changes, which is as expected. For the 
steady state of the system to be stable we require that the 
diagonal of the Jacobian has only negative terms. Thus 
autoregulation cannot qualitatively change the form of 
the output power spectrum P xx (lo). In fact, once lin- 
earized, the dynamics of a network with autoregulation 
is equivalent to that of a simple cascade with a different 
degradation rate. In terms of information transmission, 
however, this is not always true, as we shall see below. 
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FIG. 2. Typical power spectra for a linear 

cascade. A: The power spectra of x and s, P xx (uj) and 
P ss (lj), together with the signal S(w) and noise N(u>) 
components of the output, for the two-step cascade 
shown in Eqn. |11| B: The frequency-dependent gain 
<7 2 (w), noise N(u) and gain-to- noise ratio (GNR). Thin 
green lines indicate the two noise contributions, 
N v ^ x (uj) (dotted) and N x (u>) (dashed). Parameters: 
k s = 10, k v = 10, k x — 1, fi v — 0.5 and [i x — 5. Vertical 
lines indicate the degradation rates of the three 
components. 



1. Autoregulation at the response x does not affect 
information transmission 

We first consider autoregulation by the network output 
x on its own production, as depicted in Fig. [3j\. For this 
motif the relaxation time of x is given by t x = —J xx = 

{-§^f{x)s)\ , where f(x) describes the effect of 
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the feedback of x onto its own production (see Eqn 
in Fig. [3j3) For negative regulation \J XX \ > fi x , while 
for positive regulation \J XX \ < \i x . Negative (positive) 
regulation therefore reduces (increases) the response time 
of x to changes in s, compared to the equivalent simple 
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cascade network for which f(x) =constant. In the output 
power spectrum P xx {oj) this change in timescale appears 
as a shift in the knee frequency corresponding to r^ 1 . A 
corresponding change can also be seen in both the gain 
and noise (see Eqn. 16 in Fig. [3p). 

However, despite these changes in the response time, 
we find that the gain-to-noise ratio for an autoregulatory 
network (Eqn. Il6b in Fig. [3j3) is identical to the gain-to- 
noise ratio for a simple (two-component) cascade. The 
effect of changing J xx on the noise and gain is identical 
(Eqn. 16i,b in Fig.[3j3) and therefore cancels in the gain- 
to-noise ratio (as we also saw previously for the effect of 
fi x in the simple cascade, Eqn. 14). The autoregulation 



by x of its own production alters the timing of produc- 
tion events. However, our constraint of equal average 
production means that the mean rate of this process in 
the two cascades is the same. Moreover, in the linearized 
regime the production of x is an identical Poissonian pro- 
cess in both simple and autoregulated cascades. Hence, 
to the extent that the system can be linearized, autoreg- 
ulation at the output of a network does not affect in- 
formation transmission. It is conceivable that non-linear 
effects cause autoregulation of the output component to 
affect information transmission, but a comparison of our 
analytical results discussed here with results of Gillespie 
simulations of the full system, suggest that the lineariza- 
tion approximation is surprisingly accurate (see also SI). 



2. Positive autoregulation within the cascade increases the 
gain-to-noise ratio 

In a cascade with autoregulation by an intermediate 
component the story is different (Fig. 
Fig. §3). 



and Eqn. 17 



First, we reiterate that since we compare the 
simple cascade and the cascade with autoregulation on 
the basis of equal average production and degradation 
rates, the noise strengths (rfe) an d (Vv) are * ne same 
for both cascades. However, as noted above the effec- 
tive relaxation timescale of component v, t v — —JyJ 
(Eqn. |3| , decreases with negative autoregulation and in- 
creases with positive autoregulation. This again leads 
to a reduction (increase) in both the gain (Fig. [4jl>, top 
left) and the noise (Fig. [4]D, top right) of the network for 
negative (positive) autoregulation, as has been reported 
previously [501133]. However, unlike the case of autoreg- 
ulation of the output x, the gain-to-noise ratio (Kig. [4j3, 
bottom left) can change as a result. 

Negative autoregulation (Fig.|4p, green) leads to a de- 
crease in the response time compared to a simple cas- 
cade, corresponding to an increase in \J VV \. This leads 
to a decrease in the gain of the autoregulated component 
5s->„M = Jvs/i^ 2 + J vv) at frequencies uj <\J VV \. Neg- 
ative autoregulation therefore tends to suppress slowly 
varying signals relative to the simple cascade. Noise 
which is introduced upstream of or at the autoregulated 
component is filtered by the feedback-modified gain in 
exactly the same way as the signal, whereas noise in- 



troduced downstream of v is unaffected. Hence negative 
autoregulation reduces both the total gain of the net- 
work, which is the product of the individual reaction 
gains g 2 (uj) — gg^ v (uj)g^ x (uj), and the noise trans- 
mitted from v to x, N v ^. x (oj) — g%^. x N v (u)), relative 
to the simple cascade. However, noise in the produc- 
tion and degradation of x is unchanged relative to the 
simple cascade. Since the total noise (Eqn. [19]d in 
Fig. EC) is the sum of independent noise contributions, 
N(lu)= N x (oj) + N v ^. x (u>), the total noise decreases by a 
smaller factor than the gain, and the gain-to-noise ratio 
decreases compared with the simple cascade. 

Conversely, positive autoregulation (Fig. |4p, red) in- 
creases the relaxation time of v, which increases 9%-y v (u)) 
at frequencies uj < \ J vv \ . We can therefore see that posi- 
tive autoregulation amplifies slowly- varying signals. This 
leads to an increase in the network gain and the noise that 
is propagated from v to x. However, since the noise that 
is introduced at x is unchanged, positive autoregulation 
at v increases the gain-to-noise ratio compared to the 
simple cascade. Fig.|3Jl) shows the comparison between a 
simple cascade and cascades with positive (red) and neg- 
ative (green) autoregulation. Hornung and Barkai previ- 
ously studied transmission of a constant signal with ad- 
ditive noise through a deterministic (noiseless) network 
[35] . and found that positive autoregulation can increase 
the signal-to-noise ratio. Our results for time-varying 
signals with intrinsic network noise parallel their results. 

Given a network with autoregulation, our constraint 
of equal production of each network component does not 
define a unique "equivalent" simple cascade. That is, 
different parameter combinations can be chosen for a 
simple cascade which satisfy the production constraint. 
The results in the preceding discussion correspond to one 
such parameter choice. Specifically, we choose the pro- 
duction rate of v in the simple cascade (Eqn. 11) to be 
k v = (f(v)), while taking the same value for ji v in both 
networks. A consequence of this choice is that the re- 
laxation time t v changes between the two cascades, as 
discussed above. One can equally well construct a sim- 
ple cascade for which the diagonal entries of the Jaco- 
bian, J QQ , are equal to those of the autoregulated cas- 
cade, so as to hold constant the relaxation time of each 
component between the two cascades. This is achieved 
by s ettin g the spontaneous degradation rate for v in 
Eqn. [TT] to be m"° w = ~ <&/(«)*)• By choosing 
this new rate, the average protein number (v) changes 
in the simple cascade, and as a result also the average 
production of x. To restore equal production of x we 
thus also require a rescaling of the kinetic production 
rate k x ew = fc:E/i" ew //i„ in the simple cascade (Eqn. 11). 
Thus, in this comparison, the diagonal entries of the Ja- 
cobian matrices of the autoregulated and simple cascade 
are the same, while the off-diagonal entry J xv = k x differs 
between the two. 

Compared to a cascade with positive autoregulation, 
this new kinetic production rate in the simple cascade 
is smaller (fc" cw < k x ). The reduction in J xv leads to a 
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FIG. 3. Autoregulation of the output component. A: Schematic representation of the negative 
autoregulation motif, where s is the input signal and x the output signal, which negatively regulates its own 
production. B: The Langevin equations of the network. C: The characteristic equations for the gain, noise and 
gain-to- noise ratio (see also section Autoregulation). 



uniform decrease in g„^ x (uj) at all frequencies. As de- 
scribed above, this affects the signal and also the propa- 
gated noise N v ^ x (uj) equally, but not the intrinsic noise 
at x, N x (uj). Thus, compared to a cascade with posi- 
tive autoregulation, the gain-to-noise ratio is reduced at 
all frequencies in the simple cascade, as can be seen in 
Fig. (black dotted) . Interestingly, the decrease in the 
gain-to-noise ratio is most pronounced at high frequen- 
cies. This is because the propagated noise N v ^, x (uj) only 
has a significant contribution at frequencies uj < /i" cw ; at 
higher frequencies the total noise is dominated by N x (ui), 
as discussed in section: The simple cascade. Thus at 
these higher frequencies, the gain is reduced relative to 
the positively- autoregulated cascade, but the noise is not, 
and so the change in the gain-to-noise is largest. For net- 
works with negative autoregulation, the converse applies: 
the gain-to-noise ratio is higher in the simple cascade 
at all frequencies, but by a larger factor for ui < ^" cw . 
Hence, the effect of positive or negative autoregulation is 
qualitatively the same in both parametcrizations. 

More generally, even if we relax the production con- 
straint on each component, and instead require only the 
total production in the two cascades to be the same (i.e., 
(/+) + (/+) = constant), we see the similar qualitative 
behaviour for the gain-to-noise ratio (see Eqn. S1-26-S1- 
28). Positively-autoregulated cascades have a larger gain- 
to-noise ratio than a simple cascade of the same length, 
while for a cascade with negative autoregulation the gain- 
to-noise ratio is smaller. For longer cascades drawing 
such general conclusions is more difficult. However, if 
the majority of parameters are kept the same between 
the simple and autoregulated cascades, as in the cases 
discussed in detail above, then we again find that posi- 
tive autoregulation increases and negative autoregulation 



decreases the gain-to-noise ratio. Furthermore, given a 
specific simple cascade one can always add positive au- 
toregulation to the network in such a way as to achieve 
a larger gain-to-noise ratio while maintaining the same 
total production cost. 

We have here considered only autoregulation via the 
production of the intermediate v. However, for autoreg- 
ulation via the degradation of v we observe similar results 
for the gain-to-noise ratio: if v suppresses its own degra- 
dation, the decrease in the effective turn-over rate leads 
to a reduction of the noise strength N v _> x (uj) , increasing 
the gain-to-noise ratio; when v enhances its own degra- 
dation rate the transmitted noise is increased, reducing 
signalling fidelity. 

C. Feedback 

Feedback, both positive and negative, corresponds to 
the upper-triangular part in the Jacobian of the lin- 
earized system (see Fig [T]) . It is known that negative 
feedback allows for adaptation as, for example, in the E. 
coli chemotaxis pathway [3J [T3J [35] . Feedback can also 
shift noise to higher frequencies [50]. We will again con- 
sider separately the two cases of feedback by the output 
x onto an upstream component and feedback by an in- 
termediate component onto a component higher up the 
cascade. 
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1. Feedback from x does not affect information 
transmission 



For negative feedback from x to v (Fig. [5]^ and Eqn. 22 
in Fig. [5j3) , the power spectrum of the response P xx (uJ) 
(Fig. [5j3, red solid) can have a resonance peak while none 
is present in the input signal (black dotted) . Surprisingly, 
this peak does not correspond to an increase in infor- 
mation transmission capabilities at the peak frequency 
(wpeak), since no peak is present in the gain-to- noise ra- 
tio (Kig. [5j3, red dashed). For positive feedback, no peak 
is present in either P xx {oj) or the gain-to-noise ratio. 

For a system with negative feedback from x to v the 
gain and noise both show a peak, but these can occur 
at different frequencies. We consider first the frequency 
dependence of the gain. At low frequencies the negative 
feedback leads to destructive interference at v between 
the input signal S(uj) and the signal that is fed back, 
X((jj). On the other hand, at high frequencies these two 
signals are exactly out of phase, and hence the inter- 
ference becomes constructive (since the feedback com- 
bines the two signals negatively). However, at frequen- 
cies ui 3> fJ-v, \i x the amplitude of the fed-back signal de- 
creases, due to averaging over the lifetimes of v and x; 
hence, even though the two signals interfere construc- 
tively, the significance of this interference decreases. To- 
gether, these three effects lead to a maximum in the gain. 
This maximum occurs at 
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/4 
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*2>Jvx Jxv\ 



(20) 



which depends on the relaxation rates /j, x , fj, v and the 
coupling (feedback) loop between v and x, J VX J XV - This 
timescale corresponds to the imaginary part of the eigen- 
values of the Jacobian (see Eqn. Sl-39). 

The frequency of the peak in the noise depends on the 
relative strengths of the two noise sources, r\ v and r\ x . 
The two noise terms are propagated differently through 
the network, because r\ x originates at the regulator of 
the feedback loop, while r\ v originates at the regulated 
component. We consider two limiting cases. If the total 
noise N(w) (Eqn. 23 3 in Fig. [5fll) is dominated by the 
transmitted noise, N v ^ x (cu), both the signal E(w) and 
the dominant source of noise originate upstream of the 
feedback loop. Effectively, therefore, the feedback affects 
both the gain and noise of the network similarly. As a 
result the peak frequencies of both the noise and the gain 
are the same. On the other hand, when the total noise 
is dominated by N x (ui), which is located downstream of 
the regulated component v, the feedback loop affects the 
signal and noise differently. As a result, the noise that is 
fed back has a different frequency profile than the signal, 
such that the peaks in the gain and the noise occur at 
different frequencies (Fig. [5p, black circles). 

One might therefore expect that when N x (ui) 
N v ^ x (u>) a peak in the gain-to-noise ratio is possible. 
However, an inspection of the expressions for the gain, 
Eqn. 23 1, and the noise, Eqn. [23|j (both in Fig. [5^ 



shows that they have the same denominator, such that 
the gain-to-noise ratio is a monotonically decreasing func- 
tion of frequency (Eqn. [23J: in Fig. [5p). The effect of the 
negative feedback is cancelled. Ultimately, this is due to 
the fact that the noise in the output x goes back into the 
feedback loop, such that the peaks in the gain and the 
noise cannot be controlled separately; in the next sec- 
tion, we show how this can be done. Furthermore, we 
note that the gain-to-noise ratio is again identical to a 
simple three-component cascade, as we also saw in the 
case of autoregulation of x. We conclude that feedback 
from x onto the cascade also has no effect on information 
transmission through the network. 

This network (Eqn[23] in Fig. [5^) also highlights the 
idea that the power spectrum of the output P xx (lo) may 
not be indicative of the information that is transmitted at 
different frequencies. We see in Fig. [5jZ> that due to the 
negative feedback P xx {ui) can have a peak at non-zero 
frequencies, even if none is present in the input signal. 
However, this peak does not correspond to the frequency 
at which the signal is transmitted most reliably. Instead, 
we can see that the peak is simply due to resonant am- 
plification of both the signal and the noise at the charac- 
teristic frequency of the negative feedback loop. 

It has been suggested [19] that a system where a neg- 
ative feedback loop acts on the response component can 
have a large peak in the gain, such that signals on spe- 
cific timescales can be selected for. If we take in Fig. [5]4_ 
not x but v to be the output of the network, we obtain 



f>7 



N{uj) JL(\v x \ 2 ) + (^ + ^)(\vv\ 2 ) 



(21) 



We observe that the gain-to-noise ratio is a monotoni- 
cally increasing function of frequency and does not show 
a peak at any specific frequencies. Furthermore we note 
that as w -> 00 the gain-to-noise ratio becomes equal 
to the gain-to-noise ratio for the one-step simple cascade 
(J„ s /2(s)), since for large ui the noise from the down- 
stream component is averaged out. Thus this network 
motif has a higher gain-to-noise at all frequencies than 
the cascade with x as the output. However, the infor- 
mation transmitted at low frequencies is less than if x 
were not present. Following the information processing 
inequality, the amount of information about s which is 
encoded in the dynamics of v is always larger than the 
corresponding information in x. By feeding back x to v 
we thus do not add more information to the signal, but 
essentially add an extra source of noise to the pathway 
from s to v. The strength of this noise is highest at fre- 
quencies uj < [i Xl and hence the effect of the feedback is 
to obscure the signal at these frequencies. As a result 
this motif acts as a high-pass filter for information. 
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2. Negative feedback within a cascade can lead to a peak in 
the gain-to-noise ratio 

In section Autoregulation we saw that the gain-to-noise 
ratio is sensitive to the precise position of autoregulation 
in a cascade. In this section we therefore study a cas- 
cade where the feedback is not from x to v, but between 
two intermediate components w and v (see Fig. [6j\ and 
Eqn. 28 in Fig. [FjjB). This also corresponds to taking the 
output of the previous feedback cascade (Fig. [j^V) as the 
input to another downstream process. 

Expressions for the gain, noise and gain-to-noise ratio 
are given in Fig.[6p. For positive feedback the gain, noise 
and gain-to-noise ratio are once again monotonically de- 
creasing with increasing frequency. However, we find that 
for a network with strong negative feedback (Hill coeffi- 
cient n > 1, see Eqn. Sl-54), the gain-to-noise ratio can 
have a maximum as a function of frequency at 



peak 



J 2 

.in' 



resonance 



J 



J 2 

XIU 



+ /4 + /4, 



n/j, w fj, v (w) n 
J K n + {w) 7 



(25) 



This peak frequency depends on the characteristic reso- 
nance frequency of the feedback loop, u> Tes , which is de- 
termined by the interactions between v and w: fi v , fj, w , 
J vw and J wv . It is additionally dependent on the relative 
strengths of the noise introduced into the network at w 
and at x. 

We can understand the appearance of this peak as 
follows. For a network with negative feedback, g 2 (uj) 
(Fig. [6jD , bottom right) has a maximum as a function of 
frequency at w rcs , the characteristic resonance frequency 
of the feedback loop. Input signals at this frequency are 
amplified by the constructive interference between the 
signal transmitted to v from s and the signal which is fed 
back from w to v. We note that the resonance frequency 
has the same form as Eqn. [20j and depends only on the 
interactions between v and w. The behaviour of the noise 
power spectrum (Fig.|6p, top right) is more complex. We 
consider two limiting cases in which different noise terms 
dominate. When the total noise is dominated by noise 
introduced at v or w, the noise is processed through the 
feedback loop together with the signal. As discussed in 
the previous section, N(u) therefore shows a peak at a 
similar frequency to the gain (black line). These two 
peaks cancel, and hence the gain-to- noise ratio (Fig. [6p, 
top left, black line) is monotonically decreasing with fre- 
quency. On the other hand, when the total noise is dom- 
inated by N x (lu) (top right, red line) the noise in the 
network is not affected by the feedback loop. Hence no 



peak is found in the noise power spectrum. In this limit, 
the peak in the gain-to-noise ratio corresponds to the 
peak in the gain at w res (top left, red line). 

From these arguments we see that the peak in the gain- 
to-noise ratio becomes more pronounced as the relative 
contribution of N x (uj) to the total noise increases. Addi- 
tionally, increasing the strength of the negative feedback 
by reducing K or increasing n leads to a more pronounced 
peak. However, this increase in the relative peak height 
comes at the expense of a reduction in the value of the 
gain-to-noise ratio at all frequencies. 

How does the gain-to-noise ratio of the network with 
feedback compare to the corresponding (four- component) 
simple cascade? We examine the ratio of the gain-to- 
noise for the network with feedback to the gain-to-noise 
of the simple cascade, 
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Interestingly, for both types of feedback there is a range 
of frequencies over which the gain-to-noise ratio increases 
relative to the simple cascade. This contrasts to the re- 
sults of section Autoregulation, where we found that au- 
toregulation affected the gain-to-noise ratio in the same 
way at all frequencies. 

This difference can again be understood in terms of 
the interference of the two signals arriving at v. As de- 
scribed above (and in Eqn.Sl-43-Sl-44), at low frequen- 
cies the signal propagated from s to v and the feedback 
signal from w to v are in phase, while at high frequen- 
cies the two signals are exactly out of phase. Hence for 
a positive feedback loop (Fig. Rjfe,F; red line) the signals 
combine constructively at low frequencies, increasing the 
gain, but destructively at high frequencies, decreasing the 
gain. Recall that, since we are comparing networks with 

\Vw 

and (|?7x| Z ) are equal in the regulated and simple cas- 
cades. In an analogous way to the autoregulation dis- 
cussed in section Autoregulation, the presence of feed- 
back between w and v affects both the signal and noise 
introduced upstream of x, but not noise introduced at 
x. Hence, at low frequencies positive feedback ampli- 
fies the signal and the noise introduced at the levels of 
v and to, but not noise introduced at x. Hence at low 
frequencies the gain-to-noise ratio increases relative to 
the simple cascade. At high frequencies, however, pos- 
itive feedback reduces the gain and the noise upstream 
of x, but not the intrinsic noise N x (uj); consequently, 
the gain-to-noise ratio is reduced compared to the sim- 
ple cascade. Conversely, a network with negative feed- 
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back (Fig. [6j5,F;green line) reduces the gain at low fre- 
quencies, reducing the gain-to-noise ratio. However, at 
high frequencies, the feedback amplifies the signal but 
not N x (uj), leading to an increase in the gain-to-noise 
ratio. 

From these results we conclude that if a cell is only con- 
cerned with low frequency input signals, it is beneficial in 
terms of information transmission to add positive feed- 
back within the signalling cascade. If the system wishes 
to respond specifically to high-frequency signals, negative 
feedback can be used to increase the fidelity of transmis- 
sion for these signals. Additionally for a strong negative 
feedback (n S> 1 or K -C (to), see Eqn. Sl-61) the gain- 
to-noise can have a peak in the regime where signalling is 
more reliable than for a simple cascade, allowing the cell 
to focus on signals in a particular frequency band. We 
note that the negative feedback motifs considered here 
do not lead to perfect adaptation to constant input sig- 
nals, which is characterised by g 2 (ui = 0) =0 and is 
necessary for true band-pass behaviour. Perfect adapta- 
tion requires that the feedback to be implemented via a 
buffer node or side branch [37] . An example of this net- 
work architecture is the E. coli chemotaxis pathway |15j , 
for which the gain-to-noise ratio does indeed indicate a 
band-pass for information [T6] . 

IV. DISCUSSION 

In this paper we have analysed information transmis- 
sion through a number of network motifs, namely cas- 
cades, autoregulation and feedback. One of the most 
important conclusions of our analysis is that to under- 
stand how reliably biochemical networks can transmit 
time-varying signals, we have to study the frequency- 
dependent gain-to- noise ratio [JB]. In particular, the 
power spectrum of the output signal may not be a good 
measure for how biochemical networks transduce time- 
varying input signals. The power spectrum of the out- 
put signal depends on the power spectrum of the input 
signal, the frequency-dependent gain, and the frequency- 
dependent noise. Only the latter two quantities are in- 
trinsic properties of the network, provided that the net- 
work detects the input via biochemical reactions that do 
not affect the statistics of the input signal ;22 . Moreover, 
we have seen that the power spectrum of the output sig- 
nal may differ qualitatively from that of the frequency- 
dependent gain-to-noise ratio. A striking example is pro- 
vided by the network with negative feedback from the 
output component, which shows a peak in the output 
signal (see Fig. (5p): while one might be tempted to con- 
clude that input signals at this frequency are transduced 
most reliably, our analysis shows that this peak in the 
output spectrum is simply the result of resonant ampli- 
fication of both the input signal and the noise in the 
network. 

Our analysis leads us to draw the following conclusions 
on the effect of autoregulation and feedback on the trans- 



mission of time-varying signals: 1) autoregulation of the 
output component does not affect the gain-to-noise ra- 
tio, and hence does not affect information transmission 
(Fig. [3p); 2) positive autoregulation of an intermediate 
component increases the gain-to-noise ratio over all fre- 
quencies, while negative autoregulation tends to decrease 
it over all frequencies (Fig. |4f3); 3) negative feedback 
from the output component onto an upstream compo- 
nent may lead to a peak in the power spectrum of the 
output, and those of the gain and the noise; yet, even 
though the peaks of gain and the noise can be at differ- 
ent frequencies, negative feedback from the output com- 
ponent onto an upstream component can not lead to a 
peak in the spectrum of the gain-to-noise ratio (Fig.[5p); 
4) positive feedback between upstream components en- 
hances the gain-to-noise ratio at low frequencies, while 
negative feedback increases the gain-to-noise ratio at high 
frequencies (Fig. [6^). Further, we note that it is possi- 
ble to achieve a peak in the gain-to-noise ratio via nega- 
tive feedback between components that are upstream of 
the output component (Fig. [6p); however, this comes at 
the expense of a reduction in the gain-to-noise ratio for 
all frequencies. We also note here that stronger band- 
pass filtering of information can be obtained with net- 
works employing integral feedback in a side branch [15]. 
as found in the networks of osmo adaptation [5] or bacte- 
rial chemotaxis [15] . Alternatively, band-pass filters for 
information transmission can be obtained via feedforward 
loops, which we will discuss in a forthcoming publication. 

Taken together these results reveal the following de- 
sign principles for the use of feedback and autoregula- 
tion in signal transduction cascades (see the schematic 
drawing Fig. [7]). Firstly, feedback and autoregulation 
can improve information transmission, but only if they 
occur upstream of the dominant source of noise in the 
cascade. Feedback or autoregulation downstream of the 
dominant noise source affects the gain and the noise sim- 
ilarly. Secondly, if signals over the full frequency range 
have to be transmitted reliably, positive autoregulation 
is advantageous, while if the cell is concerned only with 
low- or high-frequency signals, then positive or negative 
feedback can be employed. 

The approach employed here has a number of limi- 
tations. Firstly, we have used the linear-noise approxi- 
mation, and the power spectra calculated using this ap- 
proximation may deviate from those of the full non-linear 
system. We argue that this effect does not significantly 
affect our results, since we find excellent agreement be- 
tween the power spectra calculated analytically using 
the linear-noise approximation and those obtained from 
stochastic simulations of the full system (see SI). The 
second potential source of inaccuracy is the use of Eqns.[5] 
and [10] which are exactly only for linear Gaussian sys- 
tems. However, the information rate calculated in this 
approximation provides a lower bound on the informa- 
tion transmission rate of the full system [38 . 

Another limitation of our analysis is that to reduce the 
complexity of the problem, we have assumed that the net- 
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works obey the spectral-addition rule [22] , meaning that 
reactants are not consumed during reaction events. How- 
ever, irreversible modifications of a substrate molecule 
are common in biochemical networks, and reactions of 
this type can significantly change the correlations be- 
tween different network components. For instance, in a 
cascade of the type X Xi X n _x — > X n , where 

in each reaction step the reactant is consumed, corre- 
lations of the form (rjiTji+i) = ~k (Xi) appear between 
different noise terms. As a result, for this cascade the 
covariance between different components (xiXj^i) = 
[221 139) , and hence the mutual information between in- 
stantaneous levels of components Xi and Xj^i is zero 
[16]. This may suggest that these cascades cannot ef- 
fectively transmit information. Yet, the analysis of [16] 
indicates that this motif can, in fact, reliably transmit 
time- varying signals. It would therefore be of interest to 
study the effect of cross-correlations in the noise on the 
information transmission in the motifs studied here. We 
leave this for future work. 

Lastly, how could our predictions be tested experimen- 
tally? It is increasingly being recognised that stimulat- 
ing biochemical networks with time-varying signals pro- 
vides a wealth of information on the dynamics of these 
networks [2] [3j I40H43] . These experiments can also be 



used to study the reliability by which biochemical net- 
works can transmit time-varying signals. By measuring 
not only the power spectra of the in- and output signals, 
P ss (to) and P xx {uj), but also their cross-power spectrum 
P sx (u), one can obtain the frequency-dependent gain 
g 2 {(jj) = |P sa; (w)| /P ss (u>) 2 and the frequency-dependent 
noise N(ui) (see Eqn. [8|, and hence the gain-to-noise ra- 
tio. Stimulating synthetic gene circuits or existing signal 
transduction pathways and gene regulation networks of 
known architecture with time- varying signals, for exam- 
ple using microfluidic devices, would make it possible to 
test our predictions on the effect of feedback and autoreg- 
ulation on information transmission. 
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FIG. 4. A two-step cascade with autoregulation of the intermediate component. A: Cartoon of the 
negative autoregulation motif, where the intermediate component v negatively regulates its own production. B: The 
Langevin equations describing the network. C: The characteristic equations for the gain g 2 (ui), noise N(oj) and 
gain-to-noise ratio. D: The gain, noise, gain-to-noise ratio (GNR) and output power spectrum P xx (lo) plotted as a 
function of frequency for three different cascades: simple (black) , positive autoregulation (red) and negative 
autoregulation (green). Negative autoregulation reduces the gain, noise and gain-to-noise ratio. For positive 
autoregulation the opposite holds. Positive autoregulation has a smaller knee frequency in the gain-to-noise ratio 
than negative autoregulation (see also section Autoregulation). Parameters: k s — 10, k v — 100, k x — 10, fi v = 5, 
fi x = 0.5, K = (v) and v a = 200, v r = 200. E: The gain-to-noise ratio for a cascade with postive autoregulation (red 
line) and two simple cascades (black). Solid: as in D, the degradation rate of the simple cascade equals that of the 
cascade with positive autoregulation, fj, v = ^ r . Hence \J VV \ is smaller in the cascade with auto-activation, and the 
gain-to- noise ratio is larger at low frequencies. Dotted: In the simple cascade we take \i v = J", and instead increase 
the production rate J xv . This decreases the gain-to-noise ratio of the simple cascade with respect to the 
autoregulated cascade over the full frequency spectrum. Inset: the ratio of the gain-to-noise ratio of the cascade 
with positive autoregulation to that of the simple cascade; solid: /Lt„ = /i° r , dotted fj, v — J"£. The dashed red 
vertical line indicates J"£, the vertical solid red line /i" 1 ", which shows the shift in frequency dependence. 
Parameters: k s = 10, k v = 100, k x = 10, fi v = 5, fi x = 0.5, K = (v) and v = 200. 
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F(w) = JvxJxv [JvxJxv + 2 (CJ 2 — jUxMu)] (24) 

FIG. 5. Feedback from the output signal x to an upstream component, discussed in section Feedback 

. A: Cartoon of the negative feedback motif, where the output signal x negatively regulates v. B: The Langevin 
equations describing the network. C: The characteristic equations: gain g 2 (uj), noise N(u>) and gain-to-noise ratio 
g 2 (ui) I TV (id) . D: Power spectra of the output, P xx (oj), input, P ss (w), gain g 2 (oj) and noise N(u). P xx (id), g 2 (oj) and 
N(id) all exhibit a peak due to the negative feedback, while the gain-to-noise ratio is monotonically decreasing. The 
black dots indicate the peaks of the gain and noise, which occur at different frequencies (see section Feedback). 
Parameters: k s = 10, K = 0.2 (x), v = 1260, k x = 5, fi v = 5, ji x = 5 and n = 3. 
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FIG. 6. A three-step cascade with feedback from an intermediate component, discussed in section 
Feedback . A: Cartoon of a negative feedback motif, where s is the signal and x the response, and w negatively 
regulates v. B: The Langevin equations of this motif. C: The characteristic equations: gain g 2 (ui), noise N(u>) and 
gain-to-noise ratio g 2 (w) / 'N (w) . D: The effect of changing the strength of the intrinsic noise in x, N x (oj), on the 
spectra of the gain, noise, and gain-to- noise ratio of a cascade with negative feedback. N x (lu) is varied by changing 
7(= Jxw) and fj, x , in such a way that (a;) remains constant. Lines show: black, 7 = 50; green, 7 = 10; red, 7 = 0.01. 
Decreasing 7 and [i x in this way increases the relative contribution of N x (lj) to the total noise. We see that as 7 is 
reduced the gain and noise decrease at frequencies cj < fi x , but the noise increases at lower frequencies. The 
gain-to-noise ratio decreases at all frequencies. However, the peak in the gain-to-noise ratio becomes more 
pronounced. Parameters: k s = 10, j3 = 10, v = 330, K = 0.5 (w), n = 5, //„ = 10, = 10. E: The spectra of the 
gain, noise, gain-to-noise ratio, and the output power, P xx (lo). For small u>, positive feedback (red line) enhances the 
gain, noise, and gain-to-noise ratio, while negative feedback (green line) decreases these. For higher frequencies, 
negative feedback increases the gain, enhancing the gain-to-noise ratio. With negative feedback a peak in the 
gain-to- noise ratio is present (denoted by the green dot), while none is present in the output power spectrum 
-Pra(w). Parameters: k s — 10, fi w — 10, fi v — 10, fi x — 0.5, /3 = 10, 7 = 10. For positive feedback: K — 0.5 (w), 
n = 1 and v = 150. For negative feedback: K = 0.5 (w), n = 4 and v = 1700. F: Solid lines show Gfb(w) (left axis), 
the gain-to-noise ratio for networks with positive (red) or negative (green) feedback divided by that of the 
corresponding simple cascade. Relative to the simple cascade, positive feedback increases the gain-to-noise ratio at 
low frequencies, while negative feedback increases the gain-to-noise ratio at high frequencies. Vertical lines indicate 
the frequencies at which Gfb(w) = 1 (Eqn. 27). Dashed lines show the gain-to- noise ratios for the positive and 
negative feedback motifs (right axis). Parameters: k s = 10, fj, w = 10, fi v — 10, fi x = 1, ft = 10, 7 = 1 and 
K = 0.5 (w). For positive feedback: n — 1 and v = 150. For negative feedback n — 5 and v — 3300. 
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FIG. 7. A schematic drawing of the main conclusions of this paper. The frequency of the variations of the 
input is shown on the x-axis. For three different motifs the gain-to-noise ratio is shown. The arrows indicate the 
specific frequency regime for which each motif performs better with respect to a simple cascade. 



18 



Sl-1. SI 

All cascades have the following simple (linear) birth-death process for the signal 

ds 



d( .: s -n s s + T{t) (Sl-1) 



Sl-2. GILLESPIE SIMULATIONS 



The linearization used in the derivation can change the characteristics of the frequency response. A linearized 
system does not change the frequency of the transmitted signal. However, this may not be the case for a non-linear 
system. To study this, we performed Gillespie simulations of the full system. The positive and negative regulation 
in our networks arises from Hill-like interactions between components. In the Gillespie simulation we calculated the 
propensities for every reaction with identical expressions. For example, in the network with negative feedback from 
w to v, we model reactions like Eqn. la in[6j3 as 

S^S + V (Sl-2) 

where r is 

vK n s 



T K n + w r ' 



(Sl-3) 



In these equations the actual copy number w is used, and not («;), as in the linearized expressions (Eqns. 2a, 2b in 
Fig. |6p). 

The power spectra are calculated using 2 11 (2048) exponentially distributed frequencies from lo = 10~ 3 to 
uj = 10 3 and averaged over 2 4 neighbouring frequencies to obtain a single data point. In total we have 2 7 data- 
points. The length of the simulation is 10 6 seconds, or a maximum of 10 9 events. For every run 50 blocks are averaged. 

The positive feedback loops considered here display bistability. For the positive feedback loops a constant low level 
production is added to drive the system to the stable state with high copy numbers, instead of the stable state where 
the copy number equals zero. For the positively autoregulated component this is described by that 

dt [ if v = 

Linearizing this we find that the fluctuations follow 

dv _ vK (s) _ vK _ 

— = -fi v v + r) v - v + s (Sl-5) 

at K + (v) K + (v) 

which is equivalent to the linearization of Eqn. 1 in Fig. |4]A. The addition of the basal expression therefore drives the 
system to a specific steady state, but does not change the dynamic behaviour around this steady state. 
For positive feedback within the cascade, the motif is described by 

= a + k w v - fi w w + rj w . (Sl-6) 



Taking different values for a — 0.1, 1, 10 does not lead to qualitatively different answers (see Fig. Sl-4). Again, the 
basal production changes the steady state, but not the dynamical behaviour around the steady state. 
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Figure Sl-1. The results (circles) of the Gillespie simulations for the linear cascade (Eqn. 11), together with the 
results of the linear noise approximation (solid lines) as employed in the main text. Kinetic rates as in figure [2] 




Figure Sl-2. A) The results (circles) of the Gillespie simulations for the network with positive autoregulation of v 
(Eqn{l7|in Fig. [4^) (kinetic rates as in Fig.[4p with positive autoregulation), together with the results of the linear 
noise approximation (solid lines) as employed in the main text. To drive the system to the non-zero steady state, 
basal production of v is present (Eqn. Sl-4). The steady state of the full non-linear Gillespie simulation is slightly 
different from the steady state derived from the mathematical expressions for s, v and x. This causes the slight 
difference between the results of the linearization and the simulations. B) The results (circles) of the Gillespie 
simulations for a network with negative autoregulation on v (Eqnfl7|in Fig. [4|B). Together with the results of the 
linear noise approximation (solid lines) as employed in the main text. Kinetic rates as in Fig. [4^) with negative 
autoregulation. 
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Figure Sl-3. The results (circles) of the Gillespie simulations for a network with negative feedback from x to v 
(Eqn|22|in Fig.[5j3), together with the results of the linear noise approximation (solid lines) as employed in the main 
text. Kinetic rates as in Fig. [5p. 
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Figure Sl-4. The results (circles) of the Gillespie simulations for a network with positive feedback from w to v 
(Eqn|28|in Fig.[6j3), together with the results of the linear noise approximation (solid lines) as employed in the main 
text. Kinetic rates as in Fig. [6p> with positive feedback. To drive the system to the non-zero steady state, basal 
production of w is present (Eqn. Sl-61, A) with a = 0.1, B) with a = 1, C) with a = 10 




Figure Sl-5. The results (circles) of the Gillespie simulations for a network with negative feedback from w to v 
(Eqnj28]in Fig.|6j3), together with the results of the linear noise approximation (solid lines) as employed in the main 
text. Kinetic rates as in Fig. [6t> with negative feedback. 
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Sl-3. SIMPLE CASCADE 

The one step simple cascade is described by 



dt 

with the following characteristic equations 



dx 

= k x s - m x x + T) x (t) (Sl-7) 



9 2 M = S^2 (Sl-8a) 



N ^) = ^r^ ( S1 " 8b ) 

+ mi 



a 2 K 
N Vl 2 



(Sl-8c) 



Here, ( \r) x \ 2 ) = k x (s) + m x (x) = 2k x (s). The three component simple cascade is described by (compare Eqn. 



11) 



dv 
~dt 

dx 
~dl 



= k v s — m v v + rj v (t) (Sl-9a) 
= k x v - m x x + r] x (t) (Sl-9b) 



with the following characteristic equations 



9 2 M = 7 2+ 2wV 2 , ( S1 " 10a ) 



kl(\ vv \ 2 ) + (^+ml)(\ vx \ 2 ) 



N (w) = k (Sl-lOb) 

v ' (lo 2 + ml) (u 2 + ml) y ' 



g 2 k 2 k 2 



N k 2 x {\ Vv \ 2 ) + {u 2 + m 2 v )(\ Vx \ 2 ) 



(Sl-lOc) 



The simple cascade is used as a reference. For the kinetic rates of the simple cascade we use roman symbol (k and 
m). For the kinetic rates of the cascades with feedback regulation we use greek symbols. 

Sl-4. AUTOREGULATION 

A. Autoregulation by x 

An elementary network for autoregulation by x onto itself is 

dx 

— = f (x) s - (i x x + i] x (t) , where (Sl-lla) 

vk )k = K, negative regulation 

j (x) s = — s < .. (bl-llb) 

K + x I k = x, positive regulation 
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The gain, noise and gain-to-noise for this network are 

J 2 



5 2 (w) = "*« = ^— ((x)) 2 (Sl-12a) 



U T I Ma; g^) 



|2 



^H = ^rt (S1 " 12b) 



N Vl 2 ) (M 2 



(Sl-12c) 



For equal average production, as the simple three component cascade, (production rate k x ), we chose 

(f(x)s) = f((x))(s)=k x (s) (Sl-13) 

where the first equation expresses the fact that we assume that the average rates can be expressed by the rates at the 
deterministic steady state, thus ignoring fluctuations. Thus 

d(s) (K + (x)) 

and (\r]x\ 2 } — 2k x (s). Expressed in terms of the kinetic rates of the simple cascade, the autoregulated cascade has 



GNR = — ^- = — ^ (Sl-15) 



the following form 



which is identical to Eqn. |Sl-8c| The power spectrum of x for the autoregulated cascade is 

Jl(\r\ 2 ) + (^ + ^ s )(\ Vx \ 2 ) 
(^ + ^)(^ + (^-^>i) 2 ) 



J 2 xs (\r\ 2 ) + (^ + ^)(\ Vx \ 2 ) 

Pxx (w) = ^— ^ ^ (Sl-16) 



Following a rescaling of the kinetic degradation rate fi x , such that /u" cw = \i x — Jxx, we observe that the power 
spectrum of the simple cascade and the autoregulated cascade agree. This is because the noise term rj x depends on 
the mean rate of the production and degradation events. In steady state the average number of production events 
equals the average number of degradation events. Since by the rescaling the production is not changed, the noise rj x 
is constant. The change in \x x — » fi x cw will lead to a new steady state value (x), but not to a different number of 
degradation events. 

B. Autoregulation by v 

For autoregulation of one of the intermediate components the network is 

dv 

-jr = f («) « - VvV + Vv (t) (Sl-17a) 



dx 

— = fiv - n x x + r\ x (t) , where (Sl-17b) 



... vk I k = K, negative regulation 

J (v) s = — s < .. (Sl-lYC) 

K + v \ n = v, positive regulation 
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The gain and noise for this network are 



>2 



2 I \ \JxvJvs) r: , , 

9 H = w^m^m (sl " 18a) 



(\y v \ 2 ) + + Jl) (\y x \ 2 ) 

(W 2 +Ai2)( w 2 + J2J 



(Sl-18b) 



where Ji, s = /((«)). We equalize the production for v between the autoregulated cascade and the three component 
simple cascade (with rates k v and k x ) to obtain 



J vs 



(K + (v)) 



(Sl-19) 



and the gain-to-noise ratio for the autoregulated cascade expressed in terms of the kinetic rates of the simple cascade 
(thus using k v , k x and m v , m x where applicable) is 



N 



lol 



P {\^) + ( W 3 + J2J ^) ^ + ( U 2 + ( M 2 



d(v) 



(Sl-20) 



We keep all kinetic rates equal in the autoregulated and simple cascade that do not influence the constraint condition 
(Eqn. [Sl~19 ) (thus fi v — m v and ft — k x ). We then obtain 



9 
N 



k 2 k 2 



kl(\Vv\ 



d(v) 



(Sl-21) 



We note that for positive autoregulation \J VV \ < \i v while for negative autoregulation \J VV \ > fi v . Thus the GNR is 
larger for the positively autoregulated than the three component cascade, especially for u) < J vv . For the negatively 
autoregulated cascade the opposite holds. 

The constraint does not lead to a unique relation between autoregulated and non-autoregulated cascade. An al- 
ternative choice would be a simple three component cascade for which the degradation rate fi v is equivalent to the 
"effective" degradation rate in the autoregulated cascade. Thus m v = J*£. The production of x is then 



autoregulated three component cascade 



j k v 



k v 



Equalizing this leads to 



— ^ k x — 



kv 



m,, 



which leads to 
N 



(pk v y 



(^) (\Vv\ 2 ) + (^ + (m v f)(\ Vx \ 2 ) /? 2 (l^| 2 ) + (^) (" 2 + M 2 )(\ri x 



(Sl-22) 

(Sl-23) 
(Sl-24) 

(Sl-25) 



for the GNR of the three component simple cascade. Since for positive feedback m v < fi v , the GNR of the positively 



autoregulated cascade is larger than that of the simple cascade, especially if u> ^> m v or u) 3> /3 \\rj v 
If we allow for even more differences between the kinetic rates, but require equal production, we obtain the following 
equations (we still assume the signal to be identical in both cases) 



/j, v = Cm v and /3 = Ck x , 



(Sl-26) 
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where C is an arbitrary constant. We note that the mean level of v differs between the autoregulated and the simple 
cascade 

(v) ar = i (v) simplc (Sf-27) 



As a result we derive for the gain-to-noise ratio for the regulated cascade (using Eqns. Sl-20 Sl-26 and Sl-27) 

g 2 _ (Ck x k v ) 



N (Ck x f (m 2 ) + (- 2 + (c» v - d -^) 2 ) (M 2 ) 



(k x k v ) 



2 



(M 2 (kl 2 ) + {fi + - b 9 - 1 ^) 2 ) (l* 



(Sl-28) 



For small w the conclusions on positive and negative feedback are still valid, but for w — > oo the ratio of the GNR for 
positive feedback and a three component cascade is a function of C . Similar arguments can be made about comparing 
negative and positive feedback for u) — > oo, where again the ratio of the gain-to- noise ratio's depends on C. 

Sl-5. FEEDBACK 

A. Feedback from x to v 

An elementary system with feedback from x to v is 

dv 

— = f (x) s - fj, v v + ri v (t) (Sl-29a) 
at 

dx 

— = V - fj, x x + r]x (t) , (Sl-29b) 

where 

_ . . UK n s I k = K, negative feedback 

/ (x) s = — < (Sl-30) 

K n + x n \k = x, positive feedback 

For the gain, noise and Pxx (w) we obtain 



(J, s /3) 2 


{lo 2 + fj%) (u 2 + n x ) 




+ 2 (w 2 - 






) + K + m 2 ) 


(fel 2 ) 




(lu 2 + n*) {lu 2 + nl) 




+ 2 (w 2 - 




{JvsPf Pss (w) + 


/? 2 (k! 2 ) + 


+ m 2 ) 


(\Vx\ 2 ) 



where 



N (W) = , .,, w ,.,\ ' , t a r t a \ Wlh. .. .. XI (Sl-31b) 



Pxx (w) = T^-j — 2W 2 , — 2^ i 7 3 rr a i of 2 vT> (Sl-31c) 

(to 2 + /i 2 ) (u; 2 + [i x ] + J vx j3 [J vx p + 2 (w 2 - |U w /x x )J 



d _v{K) n (s) 



d(f(x)s) Kn + 
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We note that the GNR is independent of J vx . The peak in Pxx only exist if J vx < 0, since 

p = {JvsPfP SS 

XX (w 2 + M 2 ) ( W 2 + ^2) + J ra/3 [Jvx p + 2 ( W 2 _ ^)] 

/? 2 (k| 2 ) 

+ (lj 2 + M ?) (^ 2 + mS) + « + 2 (^ 2 - ii vl i x )} + 



A (\Vx\ 2 



+ 



(ojZ + ,i 2 ) + vl) + J vx (3 [J vx f3 + 2 ( W 2 - VvVx)] 

(Sl-33) 



^ 2 (l%| 2 



( w 2 + M 2 ) (w 2 + /x 2 ) + J ra/ 3 [J ra /3 + 2 ( w 2 - fi vf , x )} 

which are four monotonic decreasing functions of u) for J vx > 0. So only for negative feedback a peak can exist in the 
power spectrum, gain and noise (since the same argument applies to gain and noise). 

The frequency of the maximum of the gain can easily be obtained, since it coincides with the minimum of the 
denominator D 

D=(cu 2 + (lo 2 + M 2 ) + J vx (3 [j vx /3 + 2 (to 2 - . (Sl-34) 

This frequency, where the gain has a maximum, is 

cj 2 es = - 1 - [ M 2 + ^ x + 2J xv /3] , (Sl-35) 

such that we require [i 2 + [i 2 x + 2J xv fi < 0. As a check we note that D > for cj rcs so divergence is not possible. 
The maximum frequency for the noise is not the minimum of D, due to the w-dependence in the numerator. If 

P 2 (\Vv ^ (iVxl 2 ^, the cj-dependence in the noise is less strong, and the frequency of the peak of the noise shifts 

to the frequency of the peak in the gain. Although a peak in Pxx can be derived analytically ( dP J^ x is 4th order in 
uj 2 ), it is not insightful. We note that Pxx is the sum of the noise (N) and the signal (£), such that if one of these 
two dominates in Pxx the peak is likely to coalesce with the peak of the dominating term. We also note that the 
signal S depends on [i s , so the peak in Pxx is not likely to coincide exactly with the peak in the gain, since the gain 
is independent of fi s . 

Compared with a three component cascade (rates k v ,k x ) , requiring equal production, we note that 

*- = k0w (S1 " 36) 

and the three component cascade has an identical GNR as the cascade with regulation. 



B. Linear Stability Analysis and Control theory 

We now shift gears and use some methods from linear stability analysis to study the biochemical network from a 
slightly different perspective. After linearizing, the solution to the linear differential equations for the perturbations 
is (ignoring the added noise) 

^=J» (Sl-37a) 

y (t) = e Jt y (0) = Ke xt Ly (0) (Sl-37b) 

Where J is the Jacobian, with eigenvalues Ai and right eigenvectors r^. The exponential matrix (e J *) describes the time 
dependency, and can decomposed in a matrix with diagonal entries e Xi , R with the right eigenvectors (as columns) 
and L with the left eigenvectors (as rows). Alternatively, we could write down the solution in terms of the right 
eigenvectors 

y (t) = c 1 e Al V 1 + . . . + c„e A "V n (Sl-38) 



2G 



where c\ . . . c n are weighing coefficients which are obtained by solving for the initial condition. In both expressions 
we note that the exponential exponent involves A. If A is complex, we can rewrite the exponent as 

e At = e (5R A+4 9 A )t = e X,t (cQS pj^ + i sin (CJ^)) (Sl-39) 

and the fluctutations decay (if 5ft a < 0) with characteristic frequency 3a- For stability we require that \x v \i x — JxvJvx > 
0. 

Yet another different method is control theory, which we can use to describe our system. In control theory we describe 
a linear system using the convolution of a response function with the input to determine the output. In the fourier 
space this becomes multiplication, such that we have (again ignoring noise) 

V (uj) = Hi (uj) S (lo) + X fb (uj) (Sl-40a) 

X fb (uj) = Gi (uj) X (uj) (Sl-40b) 

X (w) = H 2 (uj) V (uj) (Sl-40c) 
so that the total response function between input and output is 

( si - 41 ) 

1 — tl-x (uj) Gi (uj) 

which is, if we take as transfer functions 

H x (uj) = Jvs H 2 (u) = Jxv Gi (u) = — - — (Sl-42) 

iuj + fj, v iuj + [i x iui + fi v 

equal to g (uj). 

The phase of the gain, which identifies the phase shift between s and x is 

A0 = arctan ( \ (S1 _ 43) 



UJ^ Jxv^f l^vi^x , 

We can now define uj^ 

^4, = \ZvvHx - Jxvl (Sl-44) 

which defines the frequency for which the phase difference between x and s shifts by a factor n. Since x is also the 
fedback signal, this is the phase difference between the signals in the feedback loop. For negative feedback (7 < 0) 
A<p moves from to tt for uj changing from to co. 

C. Feedback from mtoii 

For the regulated four component cascade, the network is 

dv VK n S , . ,-,„ , 

— = — u v v + n v (t) (Sl-45a) 

dt K n + w n ^ 1 y ' y ' 

^ = fj v - n w + t) w (t) (Sl-45b) 
at 



dx 

— = j W - fj, x x + rj x (t) , (Sl-45c) 



with k as before (e.g. Eqn. Sl-30 1 . We linearize and obtain 



27 



df((w)) vn(w) n K n ( S ) 

J - = ~bw (s> = - {w){ K« +{v ,rr (sl " 46b) 



where the equation Sl-46b is for negative feedback (for positive feedback the sign would be positive). The gain and 
noise are 

f^ W+WM (S1 " 47a) 



N M = " " f ..2,„2^,. " " ( S1 " 47b ) 



7 2 /? 2 (k| 2 ) + 7 2 (^ 2 + fi) (K,| 2 ) + F ( W ) (fe| 2 ) 
and 

F (w) = uj 4 + (ifi + nl + 2J vw p) u? + (J vw p ~ nvpvf , (Sl-48) 

where F is a function of the parameters in the feedback loop only. The GNR is described by C/a(uj), i.e. a 
constant divided by a function of uj. For this to have an extremum, the denominator should have an extremum. We 
differentiate and obtain 

1 ( 

"peak = -2 W)—^ + M 2 + ^ + 2 | . ISI-4!)] 

Since this expression is negative, to have uj 2 > we require negative feedback. Explicitly writing J WV J VW , we have 
for the requirement that a peak exists 

2J WV J VW = 2 / n y"^"g^ > f 7 2 ^f 4- A + £ | (Sl-50) 

/3(v) (3 vK n (g) 

H = = ^» | / x n (Sl-51) 

which gives n solutions for (w) (of which only one is real and positive) . If we constrain the production rate of v and 
w to be constant - and we assume (v) = kv ^ - then we obtain 

\ ' rn v 

vK n 



K n + (w) 

and the following expression for Eqn. |S1-50| 



<*> = £M = (Sl-52) 



we rewrite the coupling strength J m 



vw {K" + {w) n f ~ (w) Kn + (w) n (w) {^ v K) n + {k v k w { S )) n lSi " Maj 
rne g= vn (w) n ~ 1 K n (s) ^ n (s) k v (w) n = n(s)fc^ (k v k w (s)) n 

vw ' (K" + (w) n f (w) K" + (w) n (w) (fi wf i v K) n + (k v k w (s)) n [ ' ' 

For K <C (u>) positive regulation is maximized and J£° B is maximal, while negative regulation is greatly suppressed 
and | Jvw S \ is minimal. The limit n — > oo is more complicated. If K < (w), J"° s — » — oo, while JP° S — » oo for (u>) < K. 
In the opposite scenario's the limits tend to zero. This is only valid if while changing n, (w) remains constant, which 
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is true due the constraint. 

With Eqn. Sl-53 we can study w pea k in more detail and we obtain 

„ vn(w) n K n (s) , 9 9\ 

(w) (K n + (w) ) 
2k v (3n(s) (w) n 



(w) K n + (w) r 



> (tmw + + /4) 



K n + (w) 



(Sl-54) 



which, interestingly, only has a solution for n > 1. 
The power spectrum of x is 



Pxx (w) 



JlsPWPss + J 2 ? 2 (k| 2 ) + 7 2 + /4) (|^| 2 ) + F (tj) (\r, x \ 2 ) 



(Sl-55) 



which depends on fi s through P$s and therefor will have a peak for a different uj than the GNR. 
The GNR for the simple four component cascade is 



9 2 (w) 



where we chose v such that 

ky = 



( ^i; ^kj ) 



(Sl-56) 



(Sl-57) 



K n + (w) n 

to obtain equal production. We then obtain for the ratio of the GNR of the feedback cascade and a simple cascade 

GNRfb D 



G = 



GNR simplc D + Jvwf3 [Jvw p + 2 (w 2 _ 



(Sl-58) 



So that the feedback is larger if J vw j3 [J vw /3 + 2 (w 2 — (J, v fJ, w )] 0*7x1 / < 0. 
The result of this inequality is 

n K n 



Gpo S (w) > 1 if u> < fi v fi w I 1 



2 K n + (w) 



G neg (uj) > 1 if u > fJ, v fi w 1 + - 



n (w) 7 



2 K n + (w) 



(Sl-59) 
(Sl-60) 



which are Eqns. 27 from the article. The peak for the negative feedback occurs at w pe ak (Eqn. Sl-49). The negative 
feedback cascade is larger than the four component simple cascade if u> > w sw ;t c h (Eqns. 



the GNR for the negative feedback at the peak is larger than the four component cascade 



27b. Thus if Wp 0ak > uj switch 



w poak > hhf*w 



+ nl + n 2 w + 2 J vw f3 < 



n (k v /3(s)Y 



2 ( f i v ^ w K) n + {k v p (s}) r 
(k v p(s)) n 



2 + n 



(fi v fi w K) n + (k v p (s)) n 

2 



nn v n w M > (/j 

v ~r f-lw r + 



Vv 



(Sl-61) 



which is possible for large n and large M = ( w y?\_ Kn , which indicates that K <C (w), in both cases representing a 
strong negative feedback. 
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Sl-6. COMMENTS ON FIG. HE 

Here we list some additional explanation on Fig. [6ji!. In this figure, we keep the parameters fj, v , fj, w , v, /3 (= J wv ) 
and K constant, since they dictate the feedback cycle (Eqn. 1 in Fig. [6^3). We vary J xw and so that in this case, 
not the average production rate of x is constrained, but the average copy number (x) . 

To understand the dependence of the gain, noise and gain-to- noise ratio on 7 = J xw and fi x ,we note that 
9 2 ~ 7 2 9 2 ^w/U4 + u 2 ) and N ~ 7 2 /(a4 + u 2 )N v (lu) + -f 2 /(fi 2 x + uj 2 )N w {lu) + N x (lu) , where N v (u) and N w (w) are 
independent of 7 and fi x and N x (oj) = 27 (w) /(p 2 + lu 2 ) (with (w) being independent of 7 and 

For lu <C fi x , the contributions of v and w to N(lu) are proportional to j 2 / [i 2 , while the contribution of x is given 
by N x (lu) oc j/n x - Hence, for lu <C the contributions of v and w to the noise are constant, while the contribution 
of x decreases with increasing 7 and fj, x , leading to a decrease of N(u>). Since the gain is constant in this regime, the 
gain-to- noise ratio increases with increasing 7 and /i for lu fi x . For lu 3> fJ. x , the gain, and the contributions of v 
and w to the noise increase with j 2 while the contribution of x to the noise increases with 7, meaning that also in 
this regime the gain-to-noise ratio increases with 7 and /j, x . 



